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Background 

Field of Invention 

[0001] The present invention relates generally to video encoding, and more 
specifically to multi-pass variable bit rate encoding. 

Background of Invention 

[0002] Encoded digital video, such as video encoded according to the Moving 
Picture Expert's Group Version 2 ("MPEG2") standard and stored on a Digital Video 
Disk ("DVD ,, ), is very commercially popular today. Contemporary video encoders are 
expected to produce high quality results, and to offer a wide variety of user controls, such 
as multi-pass variable bit rate encoding. In multi-pass variable bit rate encoding, an 
encoder makes multiple passes through a video sequence in order to attempt to set 
optimized bit rates for the frames thereof. 

[0003] Because the bit rate for video encoded on a DVD or similar medium can 
vary per frame, it is desirable to utilize variable bit rate encoding to maximize the output 
quality, as the number of bits needed to describe frames of a video sequence varies based 
on content and other factors. With fixed sized media, it is required to store an entire data 



image (e.g., a video sequence describing a film) in a fixed space (e.g., one side of a 
DVD). By varying the bit rate per frame such that individual frames are encoded at 
optimal bit rates, an attempt is made to maintain roughly constant quality throughout the 
video sequence. 

[0004] For variable bit rate encoding, it is desirable for the encoder to make 
multiple passes through the video sequence. Because the bit rate of different frames will 
vary as a function of frame complexity, the encoder can build a frame complexity profile 
during the first-pass, and then encode the sequence according to the complexity profile 
during a second-pass. 

[0005] Multi-pass variable bit rate encoding is known, but requires a trade off 
between encoding a video sequence at a target average bit rate (e.g., encoding a video 
sequence to fit on one side of a DVD) and the quality of the encoded video sequence. 
Multi-pass variable bit rate encoding as it exists in the prior art reduces the bit rate of 
complex frames by lowering the quality of those frames as needed to hit a target average 
rate. Unfortunately, this results in inconsistent quality across the video sequence as a 
whole, because more complex frames are encoded for lower quality than that of less 
complex frames. 

[0006] What is needed are robust multi-pass variable bit encoding methods, 
systems and computer program products that allow encoding of a video sequence at a 
target average bit rate while still maintaining a substantially consistent quality across the 
video sequence as a whole. 
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Summary of Invention 

[0007] An encoding manager facilitates robust multi-pass variable bit rate video 
encoding of a video sequence. In one embodiment of the present invention, the encoding 
manager performs a first-pass encoding of the video sequence, collecting modeling data 
concerning the video sequence in the process. The encoding manager utilizes collected 
modeling data to construct a data analysis model concerning the video sequence. The 
data analysis model includes a frame model which expresses a mathematical relationship 
between frame bit rate, frame complexity, frame quantization (quant) and frame bit 
overhead for each frame of the video sequence. The data analysis model also includes a 
sequence model, which specifies transitions that occur during the video sequence. 
[0008] The encoding manager utilizes the data analysis model to generate a rate 
profile for the video sequence. The rate profile complies with the bit budget for the video 
sequence, and avoids buffer underflow for each frame of the video sequence. In order to 
avoid buffer underflow, the encoding manager distinguishes between easy and hard 
segments of the video sequence, and re-allocates bits from hard to easy segments as 
needed to avoid underflow, thereby spreading any required quality loss across the entire 
segment in which the underflow occurs. The encoding manager then utilizes the rate 
profile to perform a second-pass encoding of the video sequence, adjusting quantization 
(Q) and bit rate for frames as necessary to avoid underflow and conform to the bit budget 
for the video sequence. 

[0009] The features and advantages described in this summary and the following 
detailed description are not all-inclusive, and particularly, many additional features and 
advantages will be apparent to one of ordinary skill in the art in view of the drawings, 
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specification, and claims hereof. Moreover, it should be noted that the language used in 
the specification has been principally selected for readability and instructional purposes, 
and may not have been selected to delineate or circumscribe the inventive subject matter, 
resort to the claims being necessary to determine such inventive subject matter. 

Brief Description of the Drawings 

[0010] Figure 1 is a block diagram, illustrating a high level overview of a system 
for practicing some embodiments of the present invention. 

[0011] Figure 2 is a block diagram, illustrating an encoding manager using a data 
analysis model to generate a rate profile for encoding a video sequence, according to one 
embodiment of the present invention. 

[0012] Figure 3 is a flowchart, illustrating steps for the encoding manager to detect 
and fix newly introduced hard segments, according to some embodiments of the present 
invention. 

[0013] Figure 4 is a flowchart, illustrating steps for the encoding manager to utilize 
the rate profile to perform a second-pass encoding of the video sequence, according to 
one embodiment of the present invention. 

[0014] Figure 5 is a flowchart, illustrating steps for the encoding manager to utilize 
the rate profile to perform a second-pass encoding of the video sequence, according to 
another embodiment of the present invention. 

[0015] The figures depict embodiments of the present invention for purposes of 
illustration only. One skilled in the art will readily recognize from the following 
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discussion that alternative embodiments of the structures and methods illustrated herein 
may be employed without departing from the principles of the invention described herein. 

Detailed Description 

[0016] Figure 1 illustrates a high level overview of a system 100 for performing 
some embodiments of the present invention. An encoding manager 101 performs a first- 
pass encoding of a video sequence 103, and collects data 105 concerning the video 
sequence 103. It is to be understood that although the encoding manager 101 is 
illustrated as a single entity, as the term is used herein an encoding manager 101 refers to 
a collection of functionalities which can be implemented as software, hardware, firmware 
or any combination of the three. Where an encoding manager 101 is implemented as 
software, it can be implemented as a standalone program, but can also be implemented in 
other ways, for example as part of a larger program, as a plurality of separate programs, 
or as one or more statically or dynamically linked libraries. 

[0017] The implementation mechanics of performing the first-pass encoding of the 
video sequence 103 and collecting the data 105 thereon will be apparent to those of 
ordinary skill in the relevant art in light of this specification. For example, in one 
embodiment, the encoding manager 101 performs the first-pass encoding of the video 
sequence 103 by encoding the video sequence 103 with a constant Q, without any rate 
control. In another embodiment, the encoding manager 101 performs the first-pass 
encoding of the video sequence 103 by encoding the video sequence 103 utilizing one 
pass variable bit rate encoding, thereby attempting to achieve a target bit rate. In yet 
other embodiments, the encoding manager 101 performs the first-pass encoding of the 
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video sequence 103 by encoding the video sequence 103 utilizing one pass constant bit 
rate encoding. 

[0018] Regardless of the first-pass encoding methodology utilized, the encoding 
manager 101 collects data 105 concerning the video sequence 103 to utilize to construct a 
data analysis model 107, to be used to generate a rate profile 108 as described in greater 
detail below. What data 105 concerning the video sequence 103 to collect is a function 
of the specific data analysis model 107 that the encoding manager 101 will construct. 
Examples of collected data 105 points concerning a video sequence 103 include but are 
not limited to a picture type (e.g., I frame, P frame or B frame), frame bit total, frame 
DCT bit total, average frame mquant (average macroblock q for that frame), average 
frame activity, scene change indication, fade indication, still frame indication and 
transition indication. Other examples will be readily apparent to those of ordinary skill in 
the relevant art in light of this specification. 

[0019] The encoding manager 101 uses collected data 105 concerning the video 
sequence 103 to construct a data analysis model 107 which includes both a frame model 
109 concerning each frame of the video sequence 103, and a sequence model 1 1 1 
concerning the video sequence 103 as a whole. The frame model 109 can be instantiated 
as a formula expressing a mathematical relationship between frame bit rate, frame 
complexity, frame quant and frame bit overhead for each frame of the video sequence 
103. Specifically, the encoding manager 101 can use the formula 
R = C/Q + A (1) 

as the frame model 109, where R equals frame bit rate, C equals frame complexity, Q 
equals frame quant and A equals the number of overhead bits for the frame. The 
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encoding manager 101 can use data 105 gleaned from the first-pass encoding to calculate 
constants C and A for each frame of the video sequence 103. A, the overhead bit value 
for a frame, can be calculated as total bits for the frame minus DCT bits for the frame. C, 
the complexity value for a frame, can be calculated as DCT bits for the frame times Q for 
the frame. The encoding manager 101 can then utilize the calculated constants C and A 
to solve for R for a given Q or vice versa for each frame according to the frame model 
109 or more specifically Equation (1), during the process of rate profile 108 generation, 
as described in greater detail below. It is to be understood that in other embodiments, the 
encoding manager 101 can construct the frame model 109 according to other 
methodologies as desired, for example by using the popular TM5 reference model. 
[0020] The encoding manager 101 can also utilize collected data 105 concerning 
the video sequence 103 to construct a sequence model 1 1 1 concerning the video sequence 
105 as a whole. The sequence model 1 1 1 identifies transitions in the video sequence 103, 
and is used by the encoding manager 101 during the rate profile 108 generation. The 
sequence model 111 utilizes collected data 105 such as average frame activity, scene 
change indication, fade indication, still frame indication and transition indication to 
identify sequence transitions that can be leveraged during rate profile 108 generation to 
determine proper bit rates for affected frames. The implementation mechanics of 
detecting transitions in a video sequence 103 are known to those of ordinary skill in the 
relevant art. 

[0021] Turning to Figure 2, the encoding manager 101 is illustrated using the data 
analysis model 107, including the frame model 109 and the sequence model 1 1 1, to 
generate a rate profile 108 for encoding the video sequence 103, according to one 
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embodiment of the present invention. The rate profile 108 is an allocation of bits per 
frame such that the sum thereof equals the bit budget for the video sequence 103. To 
optimize quality of the encoded video sequence 103, the rate profile 108 can distinguish 
between easy and hard segments 201 of the video sequence 103, and allocate bits to 
segments 201 as a function of segment 201 complexity, within the constraints of the total 
bit budget for the sequence 103. The rate profile 108 also allocates bits so as to avoid 
buffer 203 underflow for each frame of the video sequence 103. 
[0022] In order to generate the rate profile 108, the encoding manager 101 
calculates an initial Q for the video sequence 103, as a function of the sum of the frame 
complexity (C) for each frame (i) of the video sequence 103, the sum of the bit overhead 
(A) for each frame of the sequence 103, and the bit budget (B) for the sequence 103. 
Specifically, the encoding manager 101 can calculate the initial Q by solving for Q in the 
expression 

ZSi(Q/Q + A0 = B (2) 

Recall that the encoding manager 101 gleaned Q and Aj for each frame i during the first- 
pass of the encoding, and that B is known for the video sequence 103. Thus, the 
encoding manager 101 can solve for Q from Equation (2). 
[0023] In some embodiments, the encoding manager takes into account the 
difference between I, P and B frames, by calculating a separate initial Q for each type of 
frame, denoted by QI, QP, and QB, respectively, based on a common base Q. If the 
ratios QI/Q, QP/Q, and QB/Q are known, the encoding manager 101 can calculate QI, QP 
and QB by first solving the base Q from Equation (2) and obtaining QI, QP and QB based 
on the known ratios. For example, QI could be set to Q, QP to 1 .5Q and QB to 3Q. 
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These values can then be plugged into Equation (2) depending on the frame type of frame 
(i) to solve for Q. Subsequently, QI, QP, and QB are obtained by multiplying the set 
ratios to Q. Of course, other values of the ratios are possible, and they can be changed 
dynamically throughout the video sequence 103 as desired. In some embodiments, the 
same initially calculated Q is used for all frame types. 

[0024] Once the encoding manager 101 has calculated the initial Q (or Qs) to use, 
the encoding manager 101 can then solve for R (the frame bit rate) for each frame of the 
sequence 103, 103 by substituting the calculated Q and the constants C and A gleaned 
during the first pass into the frame model 109 described by Equation (1). 
[0025] In some instances, the encoding manager 101 makes adjustments to the 
calculated R for at least some frames. Specifically, it is generally required to meet some 
minimum number of bits per frame (the specific minimum is a function of various 
criteria, and the mechanics of determining such a minimum are known to those of 
ordinary skill in the relevant art). Where Ri for any frame i is less than the minimum 
number of bits per frame, Ri is set to equal the minimum. Additionally, if Ri for any 
frame i is less than or equal to Ai for that frame, Q would be negative which is not 
allowed. Therefore, under such circumstances, Rj for that frame is increased accordingly. 
[0026] It is also desirable to adjust Ri for transition frames in the video sequence 
103 (e.g., frames that comprise scene changes, fades, etc.). Recall that the encoding 
manager 101 gleaned transition data 105 concerning the video sequence 103 during the 
first-pass, and built a sequence model 1 1 1 identifying transitions in the video sequence 
103. In some embodiments, this sequence model 1 1 1 is now used to adjust Rj for 
transition frames, for example according to a formula whereby extra bits are allocated to 
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such frames. The specific formula(s) to use are a design choice, and can vary from 
transition type to transition type if desired. For example, Rj for a frame comprising a fade 
can be multiplied by a fade constant which is greater than one, whereas a frame 
comprising a scene change can be multiplied by a scene change constant (again, greater 
than one). In some embodiments, all transition frames can be multiplied by a single 
transition constant. Other methods can be used as desired to allocate extra bits to 
transition frames, the implementation mechanics of which will be apparent to those of 
ordinary skill in the relevant art in light of this specification. 
[0027] Once the encoding manager 101 has calculated Rj for each frame i, the 
encoding manager 101 has an initial rate profile 108 for the video sequence 103. The 
encoding manager 101 determines whether encoding the sequence 103 according to this 
initial profile 108 causes buffer 203 underflow by any frame. To so determine (and 
correct if necessary), the encoding manager 101 simulates decoding of the video 
sequence 103 according to the initial rate profile 108. During the simulated decoding, the 
encoding manager 101 determines whether any frames underflow the buffer 203, or 
overflow the buffer 203. The rate profile 108 will be corrected for any frames that 
underflow the buffer 203, and information concerning which frames overflow the buffer 
203 is used in the correction processes, as described below. 

[0028] In order to fix any buffer 203 underflow, the encoding manager 101 divides 
the video sequence 103 into multiple segments 201. A segment 201 as used herein is a 
set of contiguous frames which transition the buffer 203 from one state to another. The 
buffer 203 is assumed to be full at the beginning of the sequence 103; so the possible 
state transition for each segment 201 are beginning (full) to full, beginning (full) to 
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empty, beginning (full) to end, full to empty, full to full or full to end. The encoding 
manager 101 classifies segments 201 of the video sequence as easy or hard. In one 
embodiment, any segment 201 that transitions the buffer 203 from full (overflow) to 
empty (underflow) is classified as hard, whereas all other segments 201 are classified as 
easy. 

[0029] In order to eliminate buffer 203 underflow, the encoding manager 101 
calculates an updated Q for each hard segment 201, so as to avoid the underflow at the 
end of that hard segment 201. Prior art encoding would typically correct frames that 
cause underflow by either dropping the frame altogether, which negatively affects the 
quality of the video sequence 103, or by encoding that frame with a higher Q so as to 
allocate fewer bits to the frame and thus avoid the underflow. However, re-encoding the 
individual underflow causing frame with a higher Q negatively affects the quality of that 
frame and thus the video sequence 103. 

[0030] By addressing buffer 203 underflow by calculating an updated Q for each 
frame of the entire hard segment 201 that includes an underflow causing frame, the 
encoding manager 101 spreads the quality loss required to avoid the underflow across a 
segment 201 of frames. This minimizes the negative effect on any single frame of the 
video sequence 103. In one embodiment, in order to calculate an updated Q for a given 
hard segment 201, the encoding manager 101 recalculates an updated bit budget R ha rd for 
each hard segment 201 by subtracting the number of bits that the buffer 203 is 
underflowed (U) in that hard segment 201 from the original bit budget rate (Rongmai) for 
that segment 201 (Rhard = Roriginai - U). It is to be understood that variations on the above 
formula can be used to modify R for hard segments 201 as desired, with the commonality 
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being that the quality loss resulting from removing the underflow bits U from the 
segment is distributed between at least some of the frames of that segment 201. 
[0031] Once an updated R value is calculated for a hard segment 201, the encoding 
manager utilizes the updated R value to calculate an updated Q for that hard segment 201, 
by replacing R for B and plugging in the known Q and Aj into Equation (2). In this way, 
Q is updated so as to avoid the underflow of that hard segment 201. In some 
embodiments that employ different QI, QP and QB for I, P, and B frames, respectively, 
but the ratios QI/Q, QP/Q, and QB/Q are known, the encoding manager 101 also 
calculates updated QI, QP, and QB for the hard segment 201 based on the known ratios 
and the base Q that can be solved in the same way as described above. 
[0032] The encoding manager 101 thus calculates an updated Q (and in some 
embodiments QI, QP and QB) for each hard segment 201 of the video sequence, keeping 
track of the total number of bits subtracted from that hard segment 201. This bit total can 
then be added to the bit budget for the easy segments 201, and the updated bit budget 
used to calculate an updated Q for the easy segments 201 (in other words, the video 
sequence 103 absent the hard segments 201), according to methodology for calculating Q 
described above. In some embodiments, the encoding manager 101 also calculates a 
separate QI, QP and QB for the easy segments. 

[0033] At this point, the encoding manager 101 has a separate updated Q for each 
hard segment 201, and a common updated Q for all easy segments 201. The encoding 
manager 101 reformulates the initial rate profile 108 for the video sequence 103, based 
on the updated Qs for each hard segment 201 and the updated Q for the easy segment 
201. 
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[0034] As discussed above, in the processes of updating Q for easy segments 201, 
the encoding manager 101 adds bits to those segments 201, thereby creating the 
possibility of introducing new buffer 203 underflow (in other words, creating new hard 
segments 201). Figure 3 illustrates iterative steps which are employed by the encoding 
manager 101 in some embodiments of the present invention to detect and fix newly 
introduced hard segments 201. In each iteration, the encoding manager 101 simulates 
decoding 301 of the video sequence 103 absent any previously detected and fixed hard 
segments, according to the most recently reformulated rate profile 108. In other words, 
the encoding manager 101 simulates decoding 301 all of the easy segments as encoded 
according to the rate profile 108 reflecting the most recently updated Q for the easy 
segments 201. If the simulated decoding does not result in any underflow, the encoding 
manager 101 classifies 309 the rate profile 108 as the generated rate profile 108 for the 
video sequence 103. Otherwise, the encoding manager proceeds to step 303. During the 
simulated decoding, the encoding manager 101 identifies frames that underflow or 
overflow the buffer 203 as described above, and classifies 303 any segments 201 that 
transition the buffer 203 from overflow to underflow as hard. The encoding manager 
updates 305 Q for each hard segment 201 and Q for all remaining easy segments 201 as 
described above. The encoding manager 101 proceeds to reformulate 307 the rate profile 
108 based on the updated Qs. The encoding manager 101 repeats steps 301-307 until a 
simulated decoding of the video sequence 103 according to an initial rate profile 108 
results in no hard segments 201, or until a maximum number of iterations has been 
executed. At this point, the encoding manager 101 classifies 309 the last rate profile 108 
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used to simulate decoding of the video sequence 103 as the generated rate profile 108 for 
the video sequence 103, and proceeds to the second-pass encoding. 
[0035] Figure 4 illustrates the encoding manager 101 utilizing the rate profile 108 
to perform a second-pass encoding of the video sequence 103, according to one 
embodiment of the present invention. The encoding manager 101 encodes 401 each 
frame of the video sequence 103 according to the Q calculated for that frame by the 
encoding manager 101 during the generation of the rate profile 108. The encoding 
manager 101 determines, for each frame of the video sequence, whether the bit rate for a 
frame encoded according to its Q from the rate profile 108 is equal to the bit rate 
calculated for that frame by the encoding manager 101 during rate profile 108 generation, 
plus or minus a margin of error. If so, the encoding manager 101 proceeds to determine 
if the current encoding causes a buffer 203 underflow. 

[0036] Where the calculated Q for a frame does not result in an actualized bit rate 
within a margin of error of the calculated bit rate from the rate profile 108, the encoding 
manager 101 employs quantizer control at a macroblock level in order to produce an 
actualized bit rate within the margin of error of the rate profile 108 bit rate. Specifically, 
the encoding manager 101 constructs 403 a macroblock model for each macroblock of 
the frame. A macroblock model consists of a formula similar to Equation (1) expressing 
a mathematical relationship between bit rate, complexity, quant and bit overhead at a 
macroblock level. In one embodiment, the model is expressed as rj = Cj/qj + aj as 
described with Equation (1) for frames, except that the model is applied at a macroblock 
level, as represented here by the use of lowercase letters. In other embodiments, other 
models can be applied as desired, for example the popular TM5 reference model. 
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[0037] Where = Ci/q, + a; is used as the model, rj equals the bit rate for 
macroblock i, q equals the complexity of the macroblock, qi equals the quant for the 
macroblock (sometimes called the mquant) and aj equals the bit overhead for the 
macroblock. Similar to the process of calculating Q and A\ from data 105, Cj and aj can 
be calculated from data collected from the first attempt of the second-pass encoding 401. 
More specifically, aj can be calculated as total bits for the macroblock minus DCT bits for 
the macroblock i, and C\ can be calculated as DCT bits for the macroblock i multiplied by 
the mquant used. These calculated values for aj and C\ are then used in the model. 
[0038J To encode macroblocks with quantizer control 405, the encoding manager 
101 calculates an updated qi, for each macroblock to be encoded. In one embodiment, 
the updated qj is calculated for a macroblock as a function of base qb for the macroblocks 
of the frame remaining to be encoded and the activity mask for the macroblock i for 
which the updated qi is being calculated. Specifically, the updated qi is calculated as qi = 
q b * mask[i], where q b equals a base q for the macroblocks of the frame remaining to be 
encoded, and mask[i] equals the activity mask of the macroblock. For the first 
macroblock in a frame, q b can initially be calculated based on the initial bit rate for the 
frame as a whole (R). Because XEi(rO = R and T\ = q/qj + aj and q { = q b * maskfi], by 
substitution I2i(ci/q b * mask[i] + a*) = R. The encoding manager 101 knows R for the 
current frame and Cj and aj for each and every macroblock in that frame. The encoding 
manager 101 can also use methods known to those of ordinary skill in the relevant art to 
compute mask[i] for the macroblock. Thus, the only unknown is q b , which the encoding 
manager solves for, and then uses along with mask[i] to calculate an updated qi for the 
macroblock by solving for q s in the equation q s = q b * maskfi]. The updated qi is 
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subsequently used along with Ci and a; to calculate an updated rj for the macroblock by 
solving for in the equation T\ = c\/q\ + aj. Then, the encoding manager 101 encodes 405 
the current macroblock using qi, collecting updated modeling data in the process. 
[0039] According to one embodiment of the current invention, after encoding 405 
each macroblock using the updated T\ and qi, the encoding manager 101 updates qb for 
the macroblocks of the frame remaining to be encoded. To do so, the encoding manager 
calculates or updates a value R' which is equal to R for the frame minus the sum of the 
bits of the macroblocks encoded so far. Then, the encoding manager calculates an 
updated q b by using the equation X£i(Cj/q b * mask[i] + aO = R f , where TXi represents the 
sum of each macroblock i which has not yet been encoded. The encoding manager 101 
can thus encode 405 each macroblock using an updated rj and qi, and then update q b and 
R' accordingly. 

[0040] If the encoding of each macroblock of the frame with quantizer control is 
such that the bit rate for the frame is within a margin of error of the bit rate calculated for 
that frame by the encoding manager 101 during rate profile 108 generation, then the 
encoding manager 101 proceeds to determine if the current encoding causes a buffer 203 
underflow. Otherwise, the encoding manager 101 repeats steps 403-405 with updated 
modeling data gleaned during the last encoding, until the encoding is such that the bit 
rate for the frame is within a margin of error of the bit rate calculated for that frame by 
the encoding manager 101 during rate profile 108 generation, or until the encoding 
manager 101 has encoded 405 the frame a maximum number of times. At this point, the 
encoding manager proceeds to determining 413 if the current encoding causes a buffer 
203 underflow. 
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[0041] In some embodiments, if the encoding manager 101 has determined the 
current encoding does cause a buffer 203 underflow, the encoding manager 101 adjusts 
415 the bit rate for the current frame accordingly as a corrective measure, and re-encodes 
the frame by repeating steps 401 through 407. 

[0042] Figure 5 illustrates the encoding manager 101 utilizing the rate profile 108 
to perform a second-pass encoding of the video sequence 103, according to another 
embodiment of the present invention. For each frame of the video sequence 103, the 
encoding manager 101 refines 501 the bit rate from the rate profile 108. The specific 
factors to utilize in order to refine 501 the bit rate are a design choice, and can include 
factors such as the bit deficit for frames encoded so far, the current buffer level, the 
picture type and transition data. In some embodiments, the encoding manager 101 also 
refines 503 the complexity for the frame, according to possible factors such as average 
complexity for frames of the same type already encoded, the complexity of the last frame 
of this type encoded and the scene transition data. The encoding manager 101 proceeds 
to update 505 the model for that frame, based on the refined model parameters (e.g., 
refined bit rate and/or complexity), and uses the updated model to calculate 507 an 
optimized Q for the frame. 

[0043] In some embodiments the encoding manager 101 next performs 509 a 
conformance check on the calculated optimized Q, ensuring that it is within parameters 
for the video sequence 103, and adjusting it as desired. For example, the encoding 
manager can ensure that the optimized Q is acceptably similar to (that is, not too varied 
from) the last frame of the same type (e.g., I frame, P frame, B frame), and/or to the last 
frame adjusted for type, and/or the last n frames, where the value of n is a variable design 
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choice. The conformance check can also take into account transition data concerning the 
frame, and adjust the amount of variance to be tolerated accordingly. It is to be 
understood that the specific parameters utilized to perform 509 a conformance check, as 
well as the margins of variance to accept therein, are variable design choices. 
[0044] The encoding manager 101 proceeds to encode 5 1 1 the frame according to 
the optimized Q. The encoding manager 101 then determines whether that frame as 
encoded according to its optimized Q results in buffer 203 underflow. If not, the 
encoding manager 101 accepts 513 the encoding of the frame according to its optimized 
Q as the encoding for that frame. Otherwise, the encoding manager repeats steps 501- 
511, refining 501, 503 the model parameters as needed until the encoding manager 101 
encodes 511a frame according to an optimized Q such that the encoding does not result 
in buffer 203 underflow, or the encoding manager 101 encodes 5 1 1 the frame according 
to an optimized Q a maximum number of times. At this point, the encoding manager 101 
uses 513 the last encoding of the frame as the encoding for that frame. 
[0045] As will be understood by those familiar with the art, the invention may be 
embodied in other specific forms without departing from the spirit or essential 
characteristics thereof. Likewise, the particular naming and division of the modules, 
features, attributes, methodologies, managers and other aspects are not mandatory or 
significant, and the mechanisms that implement the invention or its features may have 
different names, divisions and/or formats. Furthermore, as will be apparent to one of 
ordinary skill in the relevant art, the modules, features, attributes, methodologies, 
managers and other aspects of the invention can be implemented as software, hardware, 
firmware or any combination of the three. Of course, wherever a component of the 
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present invention is implemented as software, the component can be implemented as a 
standalone program, as part of a larger program, as a plurality of separate programs, as a 
statically or dynamically linked library, as a kernel loadable module, as a device driver, 
and/or in every and any other way known now or in the future to those of skill in the art 
of computer programming. Additionally, the present invention is in no way limited to 
implementation in any specific programming language, or for any specific operating 
system or environment. Accordingly, the disclosure of the present invention is intended 
to be illustrative, but not limiting, of the scope of the invention, which is set forth in the 
following claims. 
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